The effect of granularity and order in XML element retrieval

The article presents an analysis of the effect of granularity and order in an XML encoded collection of full text journal articles. 218 sessions of searchers performing simulated work tasks in the collection have been analysed. The results show that searchers prefer to use smaller sections of the article as their source of information. In interaction sessions during which articles are assessed, however, they are to a large degree evaluated as more important than the articles’ sections and subsections

Seven years of INEX interactive retrieval experiments – lessons and challenges

This paper summarizes a major effort in interactive search investigation, the INEX i-track, a collective effort run over a seven-year period. We present the experimental conditions, report some of the findings of the participating groups, and examine the challenges posed by this kind of collective experimental effort

The effect of task type on preferred element types in an XML‐based retrieval system

This article examines the influence of task type on the users' preferred level of document elements (full articles, sections, or subsections) during interaction with an XML-version of Wikipedia. We found that in general articles and subsections seemed to be the most valuable elements for our test subjects. For information-gathering tasks, this tendency was stronger, whereas for fact-finding tasks, the sections seemed to play a more important role. We assume from this that users select different information search strategies for the two task types. When dealing with fact-finding tasks, users seem more likely to use one single element as an answer, while when they do information gathering, they pick information from several elements

Examining the effect of task stage and topic knowledge on searcher interaction with a “digital bookstore”

This paper reports some results from the experiment of the 2010 INEX interactive track. The experiment was designed to let searchers simulate being at two distinct stages of a work task process. Data were also collected on the test participants' topic knowledge. We have performed statistical analysis of the collected data to study differences with respect to relevance judgments and use of different types of metadata, at the different stages and for users with high and low topic knowledge

Using ‘search transitions’ to study searchers investment of effort: experiences with client and server side logging

We are investigating the value of using the concept ‘search transition’ for studying effort invested in information search processes. In this paper we present findings from a comparative study of data collected from client and server side loggings. The purpose is to see what factors of effort can be captured from the two logging methods. The data stems from studies of searchers interaction with an XML information retrieval system. The searchers interaction was simultaneously logged by a screen capturing software and the IR systems logging facility. In order to identify the advantages and disadvantages we have compared the data gathered from a selection of sessions. We believe there is value in identifying the effort investment in a search process, both to evaluate the quality of the search system and to suggest areas of system intervention in the search process, if effort investment can be detected dynamicall

Search Transition as a Measure of Effort in Information Retrieval Interaction

In this article we introduce the concept of search transitions as a unit for measuring the effort invested by searchers in information retrieval interaction. The concept is discussed and compared to traditional measures of effort, such as time. To investigate the usability of the search transition measure we have performed an analysis of 149 logs in an IR system indexing a collection of 650.000 Wikipedia articles. Our findings show that search transitions correlate with other, more mechanistic, effort measures. Additional experiments are necessary to investigate if it is a better measure of effort than e.g. number of documents examined

'Irrational' searchers and IR-rational researchers

In this article we look at the prescriptions advocated by Web search textbooks in the light of a selection of empirical data of real Web information search processes. We use the strategy of disjointed incrementalism, which is a theoretical foundation from decision making, to focus on how people face complex problems, and claim that such problem solving can be compared to the tasks searchers perform when interacting with the Web. The findings suggest that textbooks on web searching should take into account that searchers only tend to take a certain number of sources into consideration, that the searchers adjust their goals and objectives during searching, and that searchers reconsider the usefulness of sources at different stages of their work tasks as well as their search tasks

Understanding the Data Management Plan as a Boundary Object through a Multi-stakeholder perspective

A three-phase Delphi study was used to investigate an emerging community for research data management in Norway and their understanding and application of data management plans (DMPs). The findings reveal visions of what the DMP should be as well as different practice approaches, yet the stakeholders present common goals. This paper discusses the different perspectives on the DMP by applying Star and Griesemer’s theory of boundary objects (Star & Griesemer, 1989). The debate on what the DMP is and the findings presented are relevant to all research communities currently implementing DMP procedures and requirements. The current discussions about DMPs tend to be distant from the active researchers and limited to the needs of funders and institutions rather than to the usefulness for researchers. By analysing the DMP as a boundary object, plastic and adaptable yet with a robust identity (Star & Griesemer, 1989), and by translating between worlds where collaboration on data sharing can take place we expand the perspectives and include all stakeholders. An understanding of the DMP as a boundary object can shift the focus from shaping a DMP which fulfils funders’ requirements to enabling collaboration on data management and sharing across domains using standardised forms

Understanding the Data Management Plan as a Boundary Object through a Multi-stakeholder perspective

A three-phase Delphi study was used to investigate an emerging community for research data management in Norway and their understanding and application of data management plans (DMPs). The findings reveal visions of what the DMP should be as well as different practice approaches, yet the stakeholders present common goals. This paper discusses the different perspectives on the DMP by applying Star and Griesemer’s theory of boundary objects (Star & Griesemer, 1989). The debate on what the DMP is and the findings presented are relevant to all research communities currently implementing DMP procedures and requirements. The current discussions about DMPs tend to be distant from the active researchers and limited to the needs of funders and institutions rather than to the usefulness for researchers. By analysing the DMP as a boundary object, plastic and adaptable yet with a robust identity (Star & Griesemer, 1989), and by translating between worlds where collaboration on data sharing can take place we expand the perspectives and include all stakeholders. An understanding of the DMP as a boundary object can shift the focus from shaping a DMP which fulfils funders’ requirements to enabling collaboration on data management and sharing across domains using standardised forms.  [This paper is a conference pre-print presented at IDCC 2020 after lightweight peer review.

Conducting information seeking behaviour research in an international, interdisciplinary research project: experiences and reflections

Introduction. We report experiences from an international, interdisciplinary research project, in which we conduct information seeking behaviour studies. We give an overview of how we planned and scheduled the research project, which includes the application of the adapted model by Mason, and further share project challenges and relate them to the research literature. Methods. We share illustrative examples of challenges experienced as being part of an international interdisciplinary project, which we discuss in relation to the research literature on research project management. Analysis. We conduct a conceptual analysis of project challenges in light of the project management research literature. Results. We show how we have planned and scheduled the research infrastructure and share how the test design and study methodology was developed by use of the adopted Mason model. We report experiences from our project reflecting national cultures and geographical challenges, different disciplinary and institutional cultures, time and cost limitations, and budget delegation. Conclusion. We find that project success depends on a solid understanding of the nature of the research project and the work conditions and cultures of project partners. Project planning is essential, and it is necessary to be aware of constraints related to time, costs, and human resources.Peer Reviewe